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AN INSPECTION SYSTEM FOR A CONDUTT 

Hie present invention relates to an inspection system for a conduit. Hie system 
5 is particularly advantageous for use in inspecting pipes, such as sanitary and storm watci 
seweis, but can also be adapted for inspection of other conduits, for example tunnels and 
drains, in particular those used in water supply, sewerage, iixigati(Mi and drainage ^tems. 

The mspection and assessment of sewers for defects is critical to iwafat afa an 
10 effective sewerage system. Hie task is of a particular importance for the world's larger 
and older cities where demand on the system is high and the main seweis used have aged 
considerably, thereby providmg conditions conducive to the piodiKrtion of potentiaUy 
serious defe^. 

15 Sewers are presently inspected usmg a <dosed circuit televisiim cam«a which is 

mounted on a troUey configured to travel withm the length of a pipe. Hie images 
obtained by the camera are assessed by expeiienced peisonnel who identify defects and 
potential defects in the pipe^ structure on the basis of the unages. Fbisonnel can also be 
srait into pipes which are large enough fiw direct inspection, however, this is normally 

20 discouraged as, although safety precautions are stringent, thwe remams inherent risks t 
perscnmel. Both assessment tedmiques are highly subjective and open to different 
intopretations. Reliance on visual assessment is also time consumhig and places 
considerable time constraints on an inspection program when the numbo: of eacp^enced 
personnel available is limited. 

25 

Both techniques also require inspections to be undertaken at low flow levels or 
fluid flow to be diverted from the pipes being inspected. Hiis places constraints on the 
effectiveness of the sewage system and nonnally means that inspection programs have 
to be carried out at night, thereby increasing the labour cost of the program. 

30 

Sonar systems have been used to in^iect flooded pipes, but the hnages produced 
from sonar systems still need to be manually intopreted. 
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' Jn accordance with the present invention there is provided an inspection system 
for a conduit comprising measurement means for travelling in said conduit and obtaining 
data on said conduit, and processing means for processing said data to identify regions 
of said conduit corre^nding to defects in ^d conduit 

5 

Prefwably said processing means includes means for extracting dimension data 
on siaid conduit from said data obtained by said measurement means. 

Preferably said processing means includes segmentatioA means for processing said 
10 dimensdon data into segments which represent regions which could correspond to defects 
in said conduit. The processing means also preferably includes classification means for 
processing said segments to dassify said segments as corresponding to a feature of said 
conduit^ which may be a defect 

15 Preferably said classtficaticm means implements a neural network to classify said 

segments. Advantageously the system further includes interpretation means for 

processmg a dassified segment to c4>tam attributes of the corresponding feature and fOT 
identifymg said feature on the basis of said attributes and feature data. 

20 Preferably said dimension data comprises a plurality of circumferential data of the 

mner surface of said conduit each corresponding to pomts along the path of travel of said 
measurement means. 

The measurement means may include laser scanning means and/or sonar scanning 

25 means. 

Preferably the laser scanning means includes a laser, means for circulating a beam 
generated by the laser agamst the surface of said conduit, and camera means for 
producing ima^ data representative of areas illuminated by said beam. 

30 

Preferably said sonar scainning means includes a rotating sonar transducer for 
emitting sonar signals to and recdvmg sonar echoes from the inner surfoce of said 
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conduit. 

Preferably said processing means includes movement correction means for 
adjusting said circumferential data to account for movement of said measurement means 
5 within said conduit. 

Aprefeired embodiment of the present invention is hereinafter described, by way 
of example only, with reference to the accompanying drawiiugs, wherein: 
Figure 1 is a schematic diagram of an inspecticm system for a pipe; 
10 Figure 2 is a perq)ective view of a laser scanner of the system within a pipe; 

I^gure 3 is a block diagram of a feature extraction board of the systrai; 
Figure 4 is a block diagram of an MIS of the systrai; 

Figure 5 is a perspective view of a sonar scanner of the system within a pipe; 

Figure 6 is a block diagram of a sonar head of the sonar scanner; 
IS Figure 7 is a graphical reptesratation of a sonar echo produced by the sonar head; 

Figure 8 is a frequency response of a digital filter used in processing the sonar 
echoes received by the sonar head; 

Figure 9 is a graphical representation of a curve-fitted to a set of sonar echo 
samples; 

20 Figure 10 is a graphical representation of a standard sonar echo used in 

cross-correlation of measured sonar edboes; 

Figure 11 is a graphical representation of the results achieved by cross-conelation 
of the standard sonar echo with a measured sonar edio; 

* Figure 12 is a flow diagram of image processing software modules and databases 
25 of a work station of the system; 

Figure 13 is a flow diagram of an image segmentation module of the system; 
Figure 14 is a flow diagram of an image dassificatira module of the system; 
Figure IS is a diagram of a grid represrating a triangulation step of the image 
classification module; 

30 Figure 16 is a diagram of a neural network stracture used in the image 

classification module; 

Figure 17 is a flow diagram of an image interpretation module of the system; 
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Figur 18 is a diagram illustrating the coordinate axis of a vehicle in a pipe; 
Figure 19 is a diagram of coordinates for a general ellipse. 
Figure 20 is a diagram illustrating determination of vehicle yaw and pitch angles 
from a fitted ellipse; and 
5 Figure 21 is a diagram illustrating centre coordinate correction. 

A pipe inspection system 2, as shown in Figure 1, includes a laser scanner 4, a 
S€maf scanner 6» and a colour video camera 8 which are all mounted on a measmemrat 
vehicle 40 that can travel within a pipe, such as asewage pipe. Tlie measurement vehicle 

10 is self-propelled for movement through the pipe, and a chainage detector 10 is used to 
detect incremental movement of the measurement vehicle through the pipe, which enables 
the position of the measurement vehicle along the length of the pipe to be determined* 
Hie orientation of the measurement vehicle, and the scanning equipment 4 to 8, is 
determined by an orientation detector 12 whidi is also moimted on the measurement 

15 vehicle. Hie orientation detector 12 includes a gyroscope and accelerometers. Hie 
signals generated by the measurement and detection equipment 4 to 12 of the vehicle are 
salt to a processing system 14 of the inspection system 2 via a high speed 
communications link 16. The signals from the laser scaimer 4, sonar scanner 6 and 
coloiu: video camera 8 are placed in a form suitable for transmission by a laser scan 

20 converter 18, a sonar scan converter 20 and a video conditioner 22, respectively. Signals 
from the chainage detector 10, the orientation detector 12 and auxiliary sensors are 
combined and placed in a form suitable for transmission by a sensor conditioner 23. All 
the signals are combined by a link controller 24 mounted on the vehicle and which is 
coimected to the link 16. The link 16 is an optical fibre link, and the converters 18 and 

25 20 and the conditioners 22 and 23 digitise the signals produced by the scanners 4 and 6 
and the camera 8 prior to submission to the link controller 24. The link controller 24 is 
then used to time division multiplex the digital signals and convert them to optical signals 
for transmission on the Unk 16. 

30 Tlie processing system 14 can be placed outside the pipe and coimected directly 

to the link 16 or alternatively the signals on the link 16 can be transferred over a digital 
telecommunications network to a remote location of the processing system 14. The 
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processing system 14 includes a link controller 26 connected to the link 16 which is used 
to unpack or demultiplex the signals transmitted from the measurement vehicle. The link 
controller 26 is connected to other components of the processing system 14 by a VME 
(Versa Module Europe) bus architecture 28. The signals from the scanner 4 are passed 
S to imag^ processing and feature extraction circuitry 30 whi^ records the signals obtained 
for each inner drcumferentiai scan of the pipe at each longitudinal positicm, z» of the 
measurement vehide. the signals are processed to obtain dicumfCTential or ring data 
for each position z» whidi comprises a set of x,y or f,6 coordinates defining the inner 
circumferential dimensions of tte pipe. A Sim Microsystems Spsac^-l woik station 32 

10 is connected to the VMB bus 28 by a VME bus to S bus converter 34, and is used to 
process the ring data to form feature segments and ibcn classify the segments to 
determine if they correspond to a defect in the pipe structure. The processing systCTH 14 
further includes an A/D board 36 for digitising the signals from other analog sensors 
external to the pipe> and a Motorola MV 147 central processing unit 38 which is used to 

15 ccmtrol the data flow in processing system 14 and operate the scanners and detectors 4 
to 12 in real-time. Ring data for each position z is also derived from the signals 
provided by sonar scanner 6. 

The laser scanner 4 is used to obtain ring data 4 for empty pipes or the upper 
20 non-fluid sections of part frill pipes. The sonar scanner 6 is complementary, and is used 
to obtain ring data for friU pipes or the lower fluid sections of partly full pipes. The 
colour video camera 8 is used to obtain visual images of the inside of the pipe which are 
recorded onto video tape and can be used for subsequCTt visual inspection of sections of 
the pipe, if de^red. 

25 

Hie laser scanner 4, as shown in Figure 2 mounted on the measurement vehide 
40 within a pipe 42, includes a HeNe laser 44 whidb genmtes a laser beam 46 in the 
direction of travel of the support vehicle 40 substantially parallel to the axis of the pipe 
42. The beam 46 is emitted from a first end 48 of the laser 44 to whidi a mkror 50 is 
30 attached which directs the beam 46 onto a refracting prism 52. The prism 52 directs the 
beam 46 in a radial direction onto the inner surface of the pipe 42. The prism 52 is 
rotated by a stepper motor 54, mounted on top of the laser 44, so as to sweep the beam 
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46 in a circular path across inner circumferences of the pipe 42. The prism 52 completes 
a revolution every 20 milliseconds, and a complete trace 55 of the beam 46 is imaged at 
each position z of a support vehicle 40 by a CCD camera 56 moimted on the laser 44 at 
the back end 58 of the laser 44. The position z of the support vehicle 44 for each trace 
5 55 is measured by the chainage detector 10, wMdi comprises an optical encode m unted 
on a q>rocket whidi transfers the drive of an electric motor to the measuiemrat vehide 
40 as it moves lon^tudinally along the pipe 42. Tlie. trace 55* provides an accurate 
representation of the form of the mner surface of the pipe 42» at a position z from which 
x»y or r^O coordinates representative of the surface dimCTsions can be extracted, bearing 
10 in mind the trace 55 is substantially perpendicular to the pipe axis. 

The image processing and feature extraction circuit 30 indudes a feature extractor 
board 62 whidi receives the image signals generated by the CCD camera 56 of the laser 
scaimer 4» as shown in Figure 3^ The board 62 indudes a timing generation circuit 64 

15 which provides v^cal and horizontal synchronising (sync) signals to the camera 56. 
Hie sync signals are goierated by a video sync generator 66 based on a 28375 MHz 
clodc signal gen^ed by a two phase clock generator 68. Tlie clock generator 68 
generates two 28375 MHz clock signals which are 90** out of phase, the first being 
inputted to the video sync generator 66. The clock gennator 68 generates the clodc 

20 signals from a 56.75 MHz master clock 70. 

The feature extraction board 62 further includes a video processing circuit 72, a 
feature store control and an addressing circuit 74, a feature data generation drcuit 76, a 
feature storage circuit 78, and an interface 80 to the VME bus 28. Hie video processmg 

25 circuit 72 includes a camera interface 82 which buffers the video signal output by the 
CCD camera 56. The level of the video signal is compared by an analog comparator 86 
with the level of a threshold signal generated by a threshold goierator 84 to detennine 
whether the video signal corresponds to a pixel of the imaged laser beam trace 55. Tlie 
comparator 86 will produce a high signal if the video signal exceeds the threshold 

30 indicating that the inddent signal corresponds to a pixel of the trace 55, otherwise a low 
signal is produced at the output of the comparator 86* The timing of the output of the 
comparator 86 is controlled by the first dock signal. 
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The feature store control addressing circuit 74 includes feature store control logic 
88 and an address counter 90. The feature store control logic 88 receives the output of 
the comparator 86 and its timing is controlled by the first and second dodc signals 
generated by the timing graeration circuit 64. The feature store control logic 88 enables 
5 a write operation to the feature storage drcuit 78 whrai tiie output of the comparator 86 
provides a high signal. The write operation occurs at the address povided by the address 
countw 90 and the data written to that location is the contents of a pixel counter 92 and 
a line counter 94 of Uie feature data generation drcuit 76. The line count« 94 provides 
the number of the horizontal line of the current pixel corresponding to the video signal 

10 output by the camera interface and the pixel counter 92 provides the number of the 
current pixel in that line. Hie pixel counter 92 is incremented by the second clodc signal, 
and reset by the horizontal sync signal whereas the line counter 94 is incremented by the 
horizontal sync signal and reset by the vertical sync signal. The pixel counter 92 and the 
line counter 94 therefore provide x and y position data, respectively, for the current pix 1, 

IS which is only stored in the storage circuit 78 when the current pixel corresponds to a 
pixel of the laser trace 55. The feature store control logic 88 increments the address in 
the address counter 90 after performing each write operation. The contents f the 
counters 92 and 94 form a 32-bit word which is stored in the storage drcuit 78. 

20 The feature storage circuit 78 is a dual port RAM which can hold 32 K 32-bit 

words and is split into two banks for double buffer operation, i.e. one bank is writtoi to 
while the other bank is read by the VME interface 80. The feature store control logic 88 
controls the double buffer operation by ensuring that when one bank is foil, a read signal 
is provided to the VME interface 80, and then the write operation continues at the other 

25 bank. An error signal to the VME interface 80 is generated when the read operation to 
one bank is not finished yet the other bank is full of x,y data. Tlie VME interface 80 
controls the reading of data onto the VME bus, and the feature extraction board 62 
function as a slave on the VME bus 28. 

30 The sonar scanner 6, as shown in Figure 5 mounted separately on the 

measurement vehicle 40 in the pipe 42, includes a sonar head 100 whidh is based on a 
Simrad Mesotech Model 990 sonar system. The sonar head 100, as shown in Hgure 6, 
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includes a transducer 102 for emitting sonar signals and receiving the xetum echoes 106| 
and a stepper motor 104 for rotating the transducer 102 at rates up to 2 revolutions per 
second. The sonar signals and echoes 106 therefore provide a circumferential scan 108 
of the inner surface of the pipe 42 at each position z. The sonar head 100 further 
S includes a motor control circuit 105, a transmit/receive circuit 107, a signal processing 
drcuit 110 and a general control circuit 112. Hie signal processing drcuit 130 and the 
control circuit 112 are connected to the processing systeni 14 by the link 16, and the 
control drcuit 112 cm receiving a scan signal fioin the processing circuit 14 generates 
control sigoals for the motor confrol drcuit 105 and the transmit/receive drcuit 107 so 

10 that the motor control drcuit 105 begins controlling the motor 104 so as to rotate the 
transducer 102. The transmit/recehre drcuit 107 is then smtched to transmit mode s^ 
to cause the transducer to emit a short pulse of 2.2 MHz ultrasoiuc radiation and then 
reverts to recdve mode so as to receive the sonar echo^ whidi is passed to signal 
processing drcuit 110 for transmission to processing system 14. A typical return ech 

15 signal 114 is shown in Figure 7. The radial dimension r of the point on the scan 108 
conc^xmding to die edio 114 is determined from the time between sending of the sonar 
pulse and the instant T 116 when the return signal level reaches a threshold level L 118, 
as discussed hereinafter. The second polar coordinate 6 of the point on the scan 108 is 
determined from index pulses generated by the motor control circuit 106 for each 

20 incremental step of the stepper motor 104, bearing in mind the initial orientation f the 
sonar transducer 102 is known. Hie pulses are transmitted to the processing system 14 
from the motor control drcuit 106 by the control circuit 112. Frequency multiplexmg 
is used to provide separate channels with the processing system 14 for control signals to 
the head 100, and signals tran^itted to the system 14. The analog signal 114 

25 lepresenting the intensity of the sonar echo as a function of time is digitised into 12-bit 
samples at a 250 kHz sampling rate using the A/D board 36 on receipt at the processing 
system 14. Prior to sampling, an 8-th order analogue low-pass filter with a cut-off 
frequency of 100 kHz is used to remove high-frequency components of the echo whidi 
may cause aliasing of the sampled signal. Hie output of the optical encoder of the 

30 diainage detector 10 is obtained by the processing system 14 immediately after each 
sonar edio is received. 
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To determine the return time T of each sampled echo and from that the radial 
distance, r, to a feature of the inner surface of the pipe 42, three techniques are available, 
a curve-fitting tedmique, a cross-correlation technique, and a deconvolution technique. 
The curve-fitting technique involves fitting the echo samples to a curve for eadi edio 
S and then deriving the radial distance from the curve. The cross-correlation teduiique 
involves coinparing the return samples with an echo from a known radius and using the 
cross-o^lation result to determine the radial distance relative to the known radius. 

Hie curve-fitting technique is perfDnned as follows. A wat» to mr interface is 
10 an almost perfect mirror to sonar signals, and from an analysis of echoes obtamed fsfm 
a water-air interface using the transducer 102 it has been determined that a fimction of 
the form provided in equation (1) below can be used to describe a sonar echo produced 
by the sonar scanner 6. 

The parameters required to define each peak, i, of an echo, y, are the amplitude 
15 of the peak, q, the width of the peak, X^, and the time at which the peak occurs, The 
function y takes into account that the sonar signal generated by the transducer 102 has 
a trailing exponential decay at the end of the pulse. Hie derivative of the function y is 
discontinuous and the number of factors for each function is determined by the number 
of peaks detected in the return echo. A peak of the return echo is detected using an 
20 estimateof the derivative of the samples of edio. A peak is defined to occur when theie 
is a positive to negative zero-CTossing of the derivative indicating a dumge to the slope 
of the signal) and the height of the peak is greater than 5% of the maximum range of the 
samples, which eliminates for any noise inherent in the samples. Numerical 
differentiation is inherently a noise increasing operation, and to reduce noise components, 
25 a five point smoothing differentiating filter, having a frequency response as shown in 
Hgure 8, is used. Ihe filter is implemented in software and the algorithm for 
implementing the filter is provided in equation (2). 
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- 0.0833311^^2 + 0.66711^^1 " 0.66711^.1 + 0.083311^.2, 2<kin-2 C2) 
«k - Ufc.!. n-2<ksa 



wheie is tlie kth sample, is the kth sample of the filtered signal and n is the number 
of samples. 

An estnnate of tlu: time of the peak is obtained by linear interpolation of the 
5 derivative values obtained on eitiler dde of the zero-crossing as shown in equation (3). 

Hie maximum value of the peak at ^| is estimated by fitting a quadratic through 
the three points prior and including the point after the zero-*crossing of the derivative. 
An estimate of the width parameter \ is determined by locating the times of the half 
peak amplitudes on the rising and falling edges of a peak. Linear interpolation is again 
10 used between the two nearest sample values to the half amplitudes in order to obtain 
estimates of a time. Hie time difference between the peak and the half amplitude of the 
rising edge is used in preference to the falUng edge, and if the time difference between 
the peak amplitude and half amplitude is given by w, then for the rising edge 



i^^:^^ (4) 



and for the felling edge 



* -hi(04) 



(5) 



IS After obtaining ^| and c, be solved for each peak using a matrix operation 

based on equation (1), which can give a least squares solution for 



Hie echo return time or transit time T is determined to be time at which the 
function y for an echo reaches 10% of its mOTifq^im amplitude. Hie radial distance ^ 
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firom the sonar head 102 to the internal feature of the pipe 42 that reflected the sonar 
signal to gennate the echo is obtained by: 

where is the velocity of the sonar signal; and ^ and X, are the tune and width 
parameters of the maximum peak of the echo. Ihe thne is the time between the start 
5 of emission of the sonar pulse and' Hbc time a trigger signal is recdved by the processing 
system 14 from the sonar head 100 and when the asynchronous sampling clock of the 
A/D board 36 begms sampling the cdio. The signal processing circuit 110 of the head 
100 generates the trigger signal at the end of generation of a sonar pulse. Rtt^^hew is half 
the width of die sonar transducer 102, which is approximately 10 mm. 

10 

The above solution for r, can be performed in real-time using the microprocessor 
38, or altonatively the work station 32 can be used and the initial parameter estimates 
for 4>„ X, and c, fed to an finins module of an algebra software package MATLAB to 
mimmise the error between the fitted fonction y and the samples. An example of the 
IS results obtahied for a three peak echo 120 is illustrated in Figure 9. 

The ooss-correlation techniique first requires a standard sonar echo to be selected 
for cross-correlation witii the echoes obtafaied in tiie pipe 42. A series of 10 edioes from 
an airAvater inter&ce were used to construct a standard echo temfrfate. The edioes were 

20 xecor^ ushig a cathode ray oscilloscope, at 8-bit resolution with a sample rate of 
5 MHz and as there was a significant amount of switching noise and other signals, the 
echoes were averaged, the of&et removed and the signal normalised. The tonplate was 
di^tally low-passed filtered using a 30 point filter with a cut-off frequency of 660 kHz. 
The leading signal of the standard peak is tmncated so that the first point in the signal 

25 represents the beginning of the rise, which is the first part of the returning echo detected 
by the transducer 102. Therefore by truncating the standard signal in tiiis manner the 
signal represents the shortest distance from the transducer 102 to a reflecting surface. 
The signal was then dcchnated according to tiie actual sampling period of the measured 
echoes to form the standard peak. Tlie standard echo signal 122 is illustrated in 
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Figure 10. 



10 



15 



A standaid cross-correlation algorithm applied to a measured echo and the 
standard echo, is as follows: 



x(k) is the measured sampled sonar echo» 

y(k) is the standard sonar echo, and 

RjqrCk) is the cross-correlation of the vectors x(k) and yCk). 

The location of the peaks of the cross-correlation are determined using equation 
(3), as discussed previously^ and the location of the peaks gives the time lag between the 
standard and measured signals. An example of a typical cross^^correlation 124 is shown 
in Figure 11. From the cross-correlation 124, the parameters ^ and X| can be determined 
for the measured echo and the radial distance ^ detomined using equation (6). Hie 
cross-correlation method is significantiy &ster than tiie curve-fitting method when the 
latter uses the optimisation module finins, howevn, die former method assumes that the 
return echo has the same profile as the standard edio. 

An alternative technique for obtaining the parameters 4>, and \ for equation is to 
apply a deconvolution algorithm, as follows, to the standard echo and the return edio. 



I^yOO = E 3cO)yO+k), - N + lik^N-1 



(7) 



where: 




(8) 



where 



X(f) - DFTCxCIO} = E ^ 



N 



. f 



N - 1, 



is the discrete Fourier transfonn of the measured sampled sonar edio x^). 
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DFr-»{X(0) = :^ r X(Oe . k = 0. ... N - 1. 
" j-o 

is the inverse discrete Fourier transform of X(f), 

S^) is the signal lesuitiiig from the deconvolution of x(k) with y(k), 
31^) is the measured samfde sraar echo, 

y(k) is the standard sonar echo with discrete Fourier transform Y(f), 
5 Y*(f) K the oonq>lex conjugate of Y(f), and 

s is a small constant to pxwent divfeion by zero. 

Hic accuracy of the raw ring data (x,y and r,e data) for each position z obtained 
from the laser scanner 4 and sonar scanner 6, as discussed above, can be improved by 

10 correction for movement of the measurement vehicle 40. The measurement vehicle 40 
cannot be constrained to remain at the centre of the pipe 42 and orientated parallel with 
re^)ect to the longitudinal axis of the pipe 42. Measurements obtained from the vdiide 
orientation detector 12 and the measured data can be used to detemune componoits of 
motion of the measurement vehide 40, sudi as x and y offsets from the centre of the pqw 

15 42 to the prism 52 and the sonar head 102, and the yaw and p^ angles f the 
measumment vehicle 40. A method Cot conecting the raw data is discussed m the 
accompanying Appaadix on pages 45 to 49, and hivolves obtainmg the effects of the 
vehicle motion from the measured data and processing the measured data by a 
transformation required to transfonn a fitted ellipse onto a cirde centred m the middle 

20 of the fipc. Ihe mediod assumes the pipe 42 is drcular and first fits the ellipse t the 
ring data obtaining from the scanners 4 and 6. Having defined a fitted ellipse for the ring 
data, a transformation matrix is obtahied which can be used to transform the ring data 
onto a drde conespondmg to the assumed cross-section of the pipe 42. Definmg the 
ellipse also provides of&ets x^y^ to the centre of the pipe 42 which are used to correct 

25 the cylindrical ring data so as to be centred on the centre of the pipe 42. The Appendix 
also describes how the yaw and pitch angles of the vehicle can be determmed from the 
measured data and this can be used for comparison with signals obtained from a 
gyroscope of the vehicle orientation detector 12. The comparison enables adjustment of 
the measured yaw and pitch angles and calibration of the gyroscopes. 
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The plurality of ring data obtained over a length of the pipe 42 from the laser 
scanner 4 and the sonar scanner 6 each comprise a set of raw range data representing an 
image of the inner surface of the pipe which can be subjected to image processing. Ihe 
range data comprises a set of z values^ and for each value z is a plurality of x,y or r,B 
5 dimension values, corresponding to the features of the inner surface at each position z. 
All the x,y and r»6 values correspond to pixels of die usage of the iimer surface of the 
pipe 42. 

The work station 32 first perfimns linage preprocessing 200 on the r^ 
10 and then segments the pixels into regions of interest using an image segmentation 
procedure 202, as shown in Figure 12. The segmented regions are classified using a 
feed-forward neural network classifier of an image classification procedure 204. A 
dasher training procedure 206 trains the network classifier off-Une using the 
back-propagation method. Hie dassifier training procedure 206 relies on a training set 
15 prepared by a preparation procedure 208. The training set preparation procedure 208 
generates training data based on results obtained by performing the image segmentation 
procedure 202 on a known pipe structure with known defects. The results of the image 
classification procedure 204 are provided to an image interpretation procedure 208 which 
further defines the classified features of the image on the basis of a knowledge database 
20 210 of known pipe features. A graphic display of the interpreted image can be produced 
at step 210 and an automatic defect report 212 produced at step 214» the reports generated 
being stored in a ^ctured database 216. 

The image preprocessing foocedure 200 removes insignificant variations in the 
25 range data and places it in a form which is not dependent on the type of scanner 4 or 6 
used. The image preprocessing procedure 200 involves first processing the range data 
to produce a calibrated constant grid map of the internal surface of pipe 42» where the 
map is two dimensional and the surface of the pipe is considered to be split longitudinally 
and opened to expose the surface. The x,y and r,8 values for each pixel obtamed by the 
30 scanners 4 and 6 are calibrated and converted into dqpth values. Provision can also be 
made for pipe manufacturing tolerances. Hie depth value of each point on the grid map 
is determined by takhig the depth value of the closest pbcel to the point. Linear 
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inteipolation can be used at an increased computational cost, but it has been found that 
the iminovement gained does not justify the cost. 

The image prepnKcssing procedure 200 involves generation of a pipe model, 
5 which represents a perfect pipe with no defects or features. ITie model provides a 
reference level with rsspcct to whidi ran^ or d^th vahies can be measured. 

Two techniques for data driven model graeration have been implemented as part 
of the system 2. In each the first step is the identificatiQn of pixels in the image which 
10 are likely to be part of a defective region by differential geometric techniques. 

^quadratic surface patdies are used to estimate image surface derivatives as 
described in "Sur&ces in Elange Image Understanding" by Paul J. Besl, Spring^-Veriag, 
1988. Pixels with small first dorivatives may be called good pixels. 

15 

fin the first model building technique the model is built ring by ring. An ellipse 
of best fit is determined for all the good pixels in a ring. The ellipse of best fit is 
obtained in the same &shion as discussed previously. 

20 In the second model building tedinique the image is systematically covered with 

facets which are rectangular subimages. The facet with the largest number of good pixels 
is chosen. Multiple bilinear regression is carried out. If fliis is successftU then tte model 
is determined at that facet and the facet is "written" which means that all the pixel values 
in the facet are set to the values determined by the regressi<m. If the regression is not 

25 successful then the facet is skii^ and the best remaining &cet is chosen. The 
regression will be succ^ful if there are enough good pixels in the £icet to get reliaUe 
results and the regression equaticms have a unique solution. Note that once a &cet has 
"writtm" all its pixels become good. 



30 



After one pass through the &cets in the unage if thne are any fac^ not wiittra 
then the "read" size of the facets is inaemented. This means that they examine pixels 
over a larger region when canymg out the regressions. When a regression for a fecet is 
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successful it writes only to its initial region and not the extended read region. Successive 
passes are made in this way through the list of facets until all facets arc written. 

Ihe advantage of the local facet method is that it applies to pipes of any shape. 

5 

The bilinear multiple regression for a facet is carried out by finding a facet ot 
planar surface given by 

fOtO^) » c + m,x + nojy, 

^^ch minimises 

E(c m,, mj) = J^(f(Xp yj) - 2/ « J^(c + + m^yj - 

Here 2^ is the range value of the pixel (x„y,) which is the itb good pixel in the 
10 rectangular subimage mdex consideration. 

This minimum occurs with the vanishing of the following d«nvatives. 

- £2(0 + m,Xi + m^^-z^x^ 
— = ^2ic + m,x, + ffljyj - zp y, 

- This occurs when the following system of equatioi^ is satisfied. 

J i 1 

'£x^c + J^xfmj + Ex^^ = J^x^, 
I i i i 

This is a linear system and can be solved by standard methods. 

15 

The data of the laser scanner 4 usually has data values missing which may be 
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caused by a light absorbing surface, obstruction of the return light signal to the camera 
56, a surface void, or surface which reflects light away from the camera 56. The missing 
values caused when an object obscures the line of sight between the camera 56 and the 
laser beam trace 55 are termed shadows. Symbolic values are assigned to all values 
5 missing on the grid map. A set of possible values are obtained for the shadow pixels and 
other missing values by projecting a line from the camera position through every pixel. 
If any of these lines intersect the line projected from the centre of the pipe through the 
grid position of the missing value and perpendicular to tibe longitudinal axis of the pipe, 
the point of intersection is added to tiie set. Since this set of possible values is assumed 
10 to be continuous only the minimum range value found need be kept for subsequent 
processing. 

Shadows are not a considerable problem for the data obtained by the sonar 
scanner 6, however, instead of a single mdial value for each point on the surface, there 

15 . may be several radial values caused by multiple echoes being returned to the sonar head 
102. The sonar data is therefore fruther pieprocessed by examination of the pixels in a 
window surrounding the current pixel, and a single depth value is chosen from amongst 
the pixel values in the window. Hie size of the window, presently 7x7, is dependent on 
the size of the area covered by the sonar signal 106 on the internal surface of the pipe 

20 42. 

The data obtained by both the laser scanner 4 and the sonar scanner 6 also 
contains a considerable amount of noise which can interfere with subsequent image 
analysis routines. Hie effects of the noise can be reduced by an image smoothing 

25 process. An adaptive smoothing process is used for its properties of reducing noise 
whilst preserving discontinuities. An equally weighted local neighbourhood averaging 
kemal which adapts itself to the local topography of the surface to smooth is used. Hie 
resulting surface is smooth within regiom; whilst it*s discontmuities (often corresponding 
to region boundaries) are preserved. Hie strategy consists of automatically selecting an 

30 adequate kemal size which defines the size of the neighbourhood. The size of the 
smoothing kemal is based on an evaluation of the differences between the value at the 
centre point of the kemal window and its neighbours. The size of the kemal is chosen 
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such that the largest absolute difference between the centre pixel and it's neighbours is 
less than or equal to twice the noise level in the image and subject to the constraints that 
the kemal size is greater than a minimum size (typically 3 by 3) and smaller than a 
maximum size (typically 19 by 19). 

5 

The image segmentation procedure 202, as shown in Figure 13, includes a feature 
extraction step 230, a pixel labelling step 222 and a region extraction step 224. The 
feature extraction stq> 220 computes a set of features which are combined to form a 
feature vector for each pixel. The features used consist of features describing more « 
10 less the range value properties of the pixel and features representing the texture in a local 
neighbourhood and indude: 
1* The row r on the grid m^ for the pixel; 

2. The column c on the grid map for the pixel; 

3. Tlie depth value f(r,c) of the pixel; 

15 4. The deviation from the Model f(r,c) - Model(r,c); 

5. First and second order derivatives of the function f at the position (r,c) based on 

estimating derivatives of digital surfaces as described in Besl; and 
6* Surface characteristics including biquadratic surface fit error, and quadratic 

variation as described in Besl. 

20 

The pixel labelling step 222 uses the feature vectors of the pixels to perform a 
dassification technique which partitions the image into regions that are uniform with 
ieq>ect to certam features and that contrast with their adjacent neighbours m the same 
features. A Nearest Neighbour Qassifier, which has been previously trained offline, is 
25 used to perform the classification. The classifier is trained to classify pixels according 
to one of the following surface primitives: 



background 
void 

30 corrosive 



root 
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Training is perfonned by extracting a set of feature vectors from suitable known 
examples of the desired surface types. The set of feature vectors becomes the exemplar 
set for the classifier. Tbe nearest neighbour classifier performs it's classification by 
comparing the unknown feature vector to ifs set of exemplars. Hie assigned 
5 classification is the same as the classification of the closest exemplar in feature ^ace 
using the Euclidean distance measure. Hie output of the pixel labellmg step 222 is a 
label list in the form of a function l(r,c) which is the primitive surface classification for 
the pixd of row r in column c. 

10 A relaxation step is used to improve the performance of the pixel labelling step. 

The underlymg assumption of the relaxation imcess is that surface primitives consist of 
locally connected regions. This assumption is translated into the statement that 
classification decisions for single pixels are not independent of the decisions for 
neighbouring pixels. In other words, if all neighbours of a pixel are classified as pixels 

15 of a certain primitive, it is very unlikely that this pixel docs not belong to the same 
primitive. Since we want to modify the classification (label) at a pixel (r,c) we define 
a refined classification r(r,c) for the initial classification l(r,c) as: 

l'(r»c) » M Oj e Netghboofhood l(ij)) 

Where neighbourhood is a certain neighbourhood (typically a 3 by 3 wmdow) of 
(ij) and M is a function of all the dassifications m the neighbourhood of the pixel at 
20 (ij). Typically M is defined as the fonction returning the mode of it's arguments. The 
output of the relaxation step is a label list in the form of a function r(r,c) which is the 
refined primitive surface classification for the pixel of row r in column c. 

The region extraction step 224 groups connected pixels having the same label into 
25 connected components* Those connected components whose pixel type is not of the 
background type are extracted to form regions of mterest R. The coordinates of a 
bounding rectangle for each region R is determmed and a bit map» map(i J), is generated 
to identify pixels of interest, i.e. those pixels within the region R belonging to the same 
connected component, where image :R -> and bit map: R-> {0,1}. The output of the 
30 region extraction step 224 is a list of regions of interest in the range image of the pipe 
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sur&ce. 

The image classification procedure 204, as shown in Figure 14, includes a filter 
step 230, an interpolation step 232, a transform step 234 and a sampling step 336 whidi 
5 process the bit maps of the regions of interest so as to place them in a form which can 
be q>plied to the neural networks of a neural network classification procedure 238. The 
output of the classification procedure 238 provides a classification for each region of 
interest and a confidence value representative of the confidence that the classificatibn & 
correct. For example, classes for surface defects may include void, crack, corrosion or 
10 deposit The confidence value may be 0 or 1, i.e. low or high, or a "fazzy" value 
between 0 and 1. 

Hie neural networks used m the neural network classification procedure 238 have 
a fixed structure, ix. a fixed number of iiq>uts and hidden layer nodes, yet the number 

15 of pixels of interest in a region of interest and the size of the region is not fixed. 
Therefore the data of the regions of interest must be manipulated so it can be applied to 
the fixed inputs of the networks, regardless of region size, and this should be done 
without sacrificing the data and true representation of the regions. This is achieved by 
first applying a defect map filter at step 232 to the bit map of each region of interest. 

20 Hie depth values for pixels of interest in the defect map are re-scaled to values between 
1 and 2 and the remaining pbcels are set to 0. This enhances the contrast between the 
pixels of interest and the remaining pixels, highlights the boundary of a defect, while 
retaining an image of the region's topography. The new image, imagel, is defined for 
all pixels(ij) in the region R by equations (9), (10) and (11) below: 

imageiaj) = 0 (9) 

25 for aU (i,j) m R where map(ij) s 0 

imageiej) = f(image(ij) - model(ij)) (10) 
for all (i,j) for which map(i j) s 1 and the label represents an "outrusion", and 



wo 95/03526 



PCT/AtJ94/00409 



-21 - 

inaagelftj) - gCmoddOj) - imageOJ)) (W) 

for all (ij) for which map(ij) = 1 and the label represents an "intrusion". The functions 
f and g are given by, for example, 

f(6) = 1 + : • : 

(maximum radius - wmnfaa^ radius) 

g(») = 1 + : * 

(nominal xadras •> tnltiimm«n ladias) 

Nominal radius is that of the pipe, and maximum laditis and miiiimum radius are the 
maximum and minimum depth or radius which the scanners 4 and 6 can detect. 
5 Model(iJ) is the pipe model value at the pixel(i j) where the pipe model can be obtained 
by either of die two methods described previously. The mtwpolation step 232 is used 
then to re-scale or compress the region of an arbitraiy size mxn to an image, imag 2 : 
{0, M-1} X {0, N-1} R, of a set size MxN so it can be applied to the neural 
networks. Transformation to the set unage size is done by triangulation of the domain 

10 of the region, which involves forming triangles with the vertices being the pixels of the 
region. The triangles have a number of different faces or "facets" orientated m different 
directions depending on the values of the pixels, and each triangle is then mapped to a 
function so as to form a continuous "facet" image. This image is then sampled onto a 
MxN grid to obtain the interpolated image. The fonn of the triangulation for a mxn 

15 region is illustrated m Kgure 15 where each grid is divided into an upper triangle 233 
and a lower triangle 235. The contmuous "fecet" hnage is defined by a function f(x,y) 
where for any point (x,y) (0 s x « m-1 and 0 ae y * n-1) in the grid map plane, f(x,y) 
is obtamed by first findhig the triangle which bounds (x,y). Hie triangle presents a fecet 
hi 3D space and f(x,y) is the height of tiie fecet above the pomt (x,y). U (x„y,) are the 

20 vertices of a triangle (i = 1, 2 and 3) and z, is the depth value coirespondmg to (x„y^, 
then t(Xty) is evaluated as follows: 

1. if (x,y) lies m an upper triangle 233 then 

f(x,y) = z, + (y - y, - x + XjKZi " «i) + Oc - x,)(z3 - z,) 

2. If (x,y) lies m a lower triangle 235 then 
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f(x,y) = 2j + (x-x, - y+ yjXzj - z^) * (y - y,)(z, - z,) 
Ibe function f(x,y) is then sampled onto an MxN grid. 

To reduce the data dunensionally further, the samples are tiansfcnmed at stq> 234 
from the spatial domain into a power Hmrtaln power spectnma using a discrete two 
5 dimrasional Fourier tramf oim. Ilie power spectrum provides a good representation of 
the regioo due to the tranrformadon process which reccmsteucts the surface in the Fourier 
domain. A disoete Fourier transfonn of image2 is performed using a recursive doubling 
strategy for Fast Fouri« Transform (FFT). The discrete Fourier txamform of an 
image f : {0, M-1} x {0, N-1} R is defined by equation (12). 

F(n.v) - £ fOcl) ^ (-I2« * 02) 

10 k,l bemg tbe cartesian coordinates of image f and u,v being the cartesian coordinates of 
the transformed samples in the power domain, 0:su,v^-l. The recursive doubling 
strategy is described in "Algorithms for Grapliics and Image Processing" by Theo 
I^vlidis, Springer-Veriag, 1982. The power spectnun is the absolute value of the 
complex Fourier transfomi which gives a power domain hnage power : {0, M-1} x 

15 {0, N-1} R, and power(u,v) = | F(u,v) | . The power spectrum is then wedge-ring 
sampled at step 236, which involves integrating, or summing, the samples in the power 
domain over eight wedge sh^ed and eight ring shaped sections of the domain. The 
result of the wedge-ring sampling provides a set of sixteen values which represent a 
compressed discrete signature of the inner surface of the pipe 42 which can be applied 

20 to the neural networks of the neural network classification step 238. The wedge-ring 
sampling is performed by first letting WEDGES be the number of wedges to be used and 
RINGS be the number of rings to be used. The interval firom 0 to Jt/2 in the power 
domain is divided into WEDGES equal' subintcivals defined by angles [9i,e|^J. The 
interval from 0 to KM-l)^ + (N-1)^^ is divided mto RINGS equal subintervals defined 

25 by radii [rj^rj^,]. The ith wedge sample is defined to be the sum of power(u,v) for all 
(u,v) such that theta(u,v) is in [61,61^ J where theta : [0,2n;] is the polar coordinate 
angle map given by 
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theta(u»v) = aictan^^ j, (u>0,v:tO) (13) 

The jth ring sample is defined to be the sum of power(u,v) for all (u,v) such that 
radius(u,v) is in [rj,rj^J where radius : [0,oo] is the polar coordinate radius map 

given by 

Thus, the ith wedge sample wedge(i) is defined by 

M-lN-l 

wedge(i) = E E power(ii,v) Xh^a (tfaeta(ii,v)X dS) 
and the jth sample iing(j) is defined to be 

mgd) » E E Power(ii,v) Xfr^ J (iadnis(u.v)), 

where for any wedge or ring set S, Xt & the characteristic function of S which indicates 
whether being theta(U|V) or radius (u^v), is in S» and is defined by 

lO if x«S 



The wedge-ring samples are put together to form a feature vector. The first WEDGES, 
in this case eight, features are the wedge samples and the last RINGS, in this case eight, 
10 features are the ring samples. 

The Fourier transform and wedge-ring sampling steps 234 and 236 preserve the 
overall shape and texture of the regions of interest and enables the neural network 
classifier to discriminate between complex surface defects. A number of factors enable 
IS this to occur, as discussed above, and are a consequence of the fact that the Fourier 
transform is an invertibie m£q>ping onto the frequency domain, and the power spectrum 
is translation invariant, which ensures the wedge-ring samples are translation invariant. 
Furthennore, the wedge samples are scale invariant and the ring samples are rotation 
invariant. This facilitates invariant classification of defects in the pipe surface. 
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ITie netiral network classification step 238 involves applying the wedge-ring 
samples to a number of feed-forward neural networks which have been trained by the 
back-propagation method. A neural network 241, as shown in Figure 16, is provided for 
each classification class of surface defects and pipe features. Hie networks 241 eadi 
5 presently have a topology of 16 inputs 243 in the input layer 239, eight nodes 235 in the 
first hidden layer 247, four nodes 249 in the second hiddm layer 251 and two outputs 
253 in the final fourth layer 255. Weights W^ij) are appUed to each value passed 
between the four layers 239, 247, 251, 255, i bemg the layer number, i being the number 
of the node or output of the layer i and j bemg the numbor of the node or input of the 
10 £+1 layer. Biases are applied to the zesult of summing all of the weighted values 
received at each node 245 and 249. Tlie outputs mdude one for an affirmative signal, 
and one for a negative ^gnal, the signal level bemg between 0 and 1 on eadi output and 
indicating a degree to which the network believes the region of intraest belongs to its 
respective dass or not 

15 

The noiral networks are Avided mto a first class which operates on images that 
represent intrusions into the pipe, and the second class which operates on images that 
represent defects or features that protrude away from the centre of the pipe 42. An 
Sample of the first dass is the tree root/non-tree root neural network classifier, and its 
20 weights and biases are listed below in natural order below, the weights for each node 
bemg provided first, starting from the first input 243 of the first layer 239 to the outputs 
of the fourth node 249 of the third layer 251, and the biases of the nodes 247 and 249 
being specified thereafter. 

25 12.746346 0.645722 2.463586 5.257362 -0.197740 8.822066 0.945439 2.853589 
0.449587 1397464 -0J33578 5.705785 1.628069 -1.967862 -0.239797 -0373825 
1377219 0 J20709 0.453015 4.017916 0.673481 -0.234437 0.156330 0.080759 3.560530 
0.024726 1.190002 -0358105 0.618113 3.074333 0.747060 1.033451 3379981 0.893241 
-0.071298 4316509 1.267015 1.493471 0.237219 0311365 2.099212 1.018908 1.023318 

30 1329006 0.670844 1.240182 0340520 0.775410 -0.014260 1.262444 -0.958270 
6363632 1.846852 -2.157752 0372251 -0.693959 -3.006805 1.458163 -1.210690 
7.822542 2.175437 -4379960 -0.061603 -1356301 -26.296545 2.685686 -10.934907 
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11.470201 5.980796 -28.453907 -4.285449 -11.180037 2.963111 0.922024 0.107060 
3.644659 0.804294 1390882 0.702610 0.869146 1^32907 1.144155 0.490662 2516481 
0.284488 0304954 0.552635 0.2306302314049 0.639178 -0.134080 3.930335 0.525155 
0.944172 0^29907 -0.047074 7.097008 0.538283 2.110033 0;402595 -0.196998 
5 5.534210 1.178307 2J93368 2.963713 1.239985 -0.773600 12.584067 1.767470 
-1303928 -0.271549 M)304803 0.201155 1.116746 -0.746619 6.032501 2.042504 
-2.044746 -0.043633 -1.141010 -1374343 0.919341 -1.191014 7.024599 1.851477 
-3.833785 -0.535100 -1.051623 -2.154537 -1302927 -1.167616 -14.931460 
-0376227 -0.283871 -0.052614 3.021743 0.684641 -^1.029852 -0.681440 -5504961 

10 2J18857 -0.470717 0.093677 18.494614 0.617955 -0325076 0.309436 5.028311 
-1376231 -2.193236 -1.027059 -14.613549 0.687801 -0.960444 -0.916111 -2.058457 
-0389501 -1.347371 -0.341156 -5.834723 -1.902474 1.838991 0517196 -0.478243 
0.028812 0.223330 3593781 -3583304 -1.741506 1305033 -0.042125 6.244700 
0.438302 -2.012424 1386442 -0.002000 -1.619284 1.642677 2.030912 -12.951331 

15 0.616731 -0.642265 

An example of the second class of neural network is the pipe join/non p^ jofa 
neural network classifier, the weights and biases of which are listed »>elow m natural 
order. 

20 

15.601082 1313890 -4.911501 2.071737 6.847770 -1.955913 0.479759 23305962 
-11.033848 0.294237 -9.093491 1.763276 13544494 -9.255530 -0530280 -12524919 
-6.430345 -0506124 1.793031 0.236400 11.959572 8.719585 0.085171 -10598364 
14.464748 0.104221 18.004253 -2.007996 -7571867 37566628 1563560 9.753113 

25 3.913759 0.088835 2.713513 0.757766 23501945 18.608824 0587159 1.179299 
-11.030748 0.242176 -5.094967 0.842696 15.003055 -2304438 -0.025316-14.214068 
-14.926097 0.035510 -11.846221 1.631934 28.704191 -10.829489 0.083905 -16.000715 
-15.083493 0.116805 -5.290942 0.712775 16.129330 -8.731529 -0.287789 -17385916 
24353518 1.897373 3.986410 1.951551 15.928616 5.156585 1.666751 32.937801 

30 3.532454 0.609612 -1327396 1.226175 3.727180 1.971728 0.745650 4.040071 1.858634 
0535590 2.401938 0.487294 -0504847 9.046494 0.441551 0.203021 -18.910927 
-0.660695 -8.226106 1381131 12.661963 -7.653401 -0.483721 -24.692900 10.056084 
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0313577 6.766282 0-206353 0.355041 22.668598 1.356813 8.777742 -1.936229 
-0.228150 6.818745 0 J94466 30.175247 23.757566 0.693519 -7394564 -7.025899 
-0.038548 -6.210098 1386558 13.0933873 -3.644164 -0309244 -8,490670 -21.163414 
-0.423117 -17.802017 2518166 33.727161 -24.713118 -1.424613 -21.156178 
5 -8.455983 0.184931 0.430795 -12.507034 -1.018161 -0.215443 -0.097470 -0.057819 
9579165 -0587254 -0.855436 -12.936895 -1.489346 -0.738745 -0.257254 2.980933 
17.244980 3.112999 -1.679418 33.106018 13.431716 -3.643328 -2.187083 -24.992414 
0.823561 -0.437280 -0.970514 -1308472 -16.635191 -2.442617 2.454849 -9.283930 
2.711961 -2.711932 0368954 -0368977 -0.886622 0.886741 -2.976039 2.976049 
10 4.088806 3.415415 -0.099539 2309209 15.089481 5.665998 3394832 5.804759 
-6328076 -1.664564 2.117919 -19312078 1332425 -1332394 

Hie weights and biases for the neural networks are established by the classifier 
training procedure 206 which uses the back-propagation method, as discussed in ''Neural 

15 Computing" by R. Beale and T. Jackson, lOP Publishing 1990, on a data set prepared by 
the training set preparation procedure 208. This involves obtaining data on known pipe 
defects and features using the pipe inspection system 2 and then on segmentation of the 
data by the segmentation procedure 202 providing the results to the preparation procedure 
206 which performs the filtering, interpolation, Fourier transform and wedge-ring 

20 sampling steps 230 to 236 to create the data sets. The data sets together with their 
known classification results are fed to the classifier training procedure 206 whidh attempts 
to seek convergence of the weights and biases using the back-propagation method to 
produce correct neural networks for each classification dass. The data sets are randomly 
interleaved, i.e. for the tree root network, the tree root data sets are interleaved with data 

25 sets that do not relate to tree roots so as to obtain accurate convergence of the weight and 
bias values. 

Filters are used with some of the dedicated networks. For example, with the 
pipe-coimection network if the bounding rec^gle length of the region of interest is less 
30 than i.FILTER or the bounding rectangle height is less than j_FILTER or the defect map 
area is less than area_FILTER then "not pipe join" is returned and use of the neural 
network is circumvented. 
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nie image inteipietation procedure 208 involves the verification and rating of 
each classified region of interest based on a database of 210 of defect and pipe feature 
characteristics and previously identified defects and features, which includes defect 
characteristics, e.g. direction/angle, gradient, area, and depdi of defects, ratings, eg. 
5 structural, service or other, and spatial relation with other defects or features. TTieimage 
interpretation procedure 208 is separated into two parts, as sliown in Figure 17, an image 
analysis step 250 which perfonns farther image analysis on the bit maps of the classified 
regions in Older to detenninc additional feature attributes associated with the pixels of 
interest, at step 252. l^e feature at&ibutes may include direction, edge details, area, 
10 position and depth of a surface feature or defect. An inference engine step 254 is 
provided to match the model of the defects provided in the knowledge database 210 using 
a set of defect identification and rating rules 256 which may be coded in an "If condition 
then conclusion- fonnat. Hie inference engine is a general pmpose feciUty. The 
vacation dependent hitei&ce functions are provided to inteifece between the engine and 
IS ' the application program's data. 

Hie image interpretation procedure 208 is supported by other procedures for the 
efficient appUcation of a knowledge base. These are: 



20 



Rule base maintenance provides fedUties for the addition, modification and 
deletion of rules from a knowledge base. 



Rule base compiler parses the knowledge base and ensures correct syntax. Ihe 
knowledge base is then translated mto a fonnat suitable for the knowledge base 
25 engine. 

The foUowing specifies the knowledge base for complete identification of the 
setvice and structural defects and features. 



30 
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SERVICE AND STRUCTURAL DEFECT SCORING RULES 
Grease 

IE legion is grease 
5 AND 

Gross-sectional area loss is less than 5%, 

THEN 

score is 1.0 * lengtfa(iii) 

10 IE region is grease 
AND 

cross-sectional area loss is not less tiian 5% 

AND 

cross-sectional area loss is less than 20% 

15 TEffiN 

score is 5.0 ^ length(m) 

Roots 

IE region is a root 
20 AND 

cross^sectional area loss is less than 5% 

THEN 

score is 2.0 

25 IE region is root 
AND 

cross-sectional area loss is not less than 20% 

THEN 

score is 5.0 

30 

Note: Root scoring varies slightly from Australian Conduit Condition Manual 
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Open Joints 

IE region is an open joint 
AND 

'openness' is less than the pipe wall thickness 

5 THEN 

scote is 0.1 

IE region is an open joint 
AND 

10 'openness' is greater than the pipe wall thickness 

AND 

'openness' is less than 13 pipe wall thicknesses 

THEN 

score is 2.0 

15 

Displaced Joints 

IE region is a displaced joint 
AND 

displacement is less than the pipe wall thickness 

20 THEN 

score is 0.1 

IE region is a displaced joint 
AND 

25 displacement is greater than the pipe wall thickness 

AND 

displacement is less than IS pipe wall thicknesses 

THEN 

score is 0.5 

30 

IE region is a displaced joint 
AND 
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displacement is greater tfaaa 1^ pipe wall thidknesses 

THEN 

score is 2.0 

5 Encrustation 

IE region is encrustation 
AND 

cross-sectional area loss is less than 5% 

THEN 

10 score is 1.0 * laigai(m) 

IE legion is raraustation 
AND 

ooss-sectional area loss is not less than 5% 

15 AND 

ooss-sectional area loss is less than 20% 

THEN 

score is 2.0 * laigth(m) 

20 IE region is encrustation 
AND 

ooss-sectional area loss is not less than 20% 

THEN 

score is 5.0 * length(m) 

25 

Scale 

IE region is scale 
AND 

cross-sectional area loss is not less than 5% 

30 THEN 

score is 1.0 length(m) ' 
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IE legion is scale 
AND 

cross-sectional area loss is not less than 5% 

AND 

5 cross-sectional area loss is less than 20% 

THEN 

score is 2.0 * lehgtii(m) 

IE region is scale 
10 AND 

cross-sectional area loss is not less than 20% 

THEN 

score is 5.0 ♦ length(m) 

15 Cracked 

IE region is a drcomferential cradc 
THEN 

score is 1.0 * length(m) 

20 IE region is a longitudinal ciack 
THEN 

score is 2.0 * lengtfa(m) 

IE region is a multiple cradc 
25 THEN 

score is 5.0 * length(m) 
Fractured 

IE region is a circumferential fracture 
30 THEN 

score is 8.0 * lCTgth(m) 
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lE region is a iongitu^nal fracture 
THEN 

score is 1S.0 * Iength(in) 

5 IE region is a multiple fracture 
THEN 

score is 40.0 * length(m) 

GasAttack 
10 IE region is^ attadc 

extent is slight 

THEN 

score is 2.0 * laigth(m) 

15 

IE region, is gas attack 
AND 

extent is medium 

THEN 

20 score is 40.0 * lengtli(m) 

IE region is gas attack 
AND 

extent is extreme 

25 TOEN 

score is 100.0 * lengtli(m) 
Erosion 

IE region is erosion 
30 AND 

extent of slight 

THEN 
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score is 1.0 * ieiigth(m) 

IE region is erosion 
AND 

S extent is medium 

TEIEN 

score is 25.0 * iengdi(m) 

IE regiion is erosion 
10 AND 

extent is large 

THEN 

score is 100.0 * iength(m) 

IS Defonned 

IE region is deformed 
AND 

deformation is less than 10% 

THEN 

20 scene is 10.0 * iaigth(m) 

IE le^on is defonned 
AND 

deformation is not less than 10% 

25 AND 

defonnatioD is less than 15% 

THEN 

score is 30.0 * length(m) 

30 IE region is defonned 
AND 

deformation is not less than 15% 
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AND 

defonnation is less than 20% 

THEN 

score is 90.0 * length(m) 

5 

IE region is deformed 
AND 

defonnation is not less than 20% 

AND 

Id defonnation is less than 25% 

THEN 

score is 125.0 iength(m) 

IE region is defonned 
15 AND 

defonnation is not less than 25% 

THEN 

score is 165.0 * length(m) 

20 Broken 

IE region is broken 
THEN 

score is 60.0 

25 Hie image interpretation procedure 208 allows the defects and pipe features 

specified in the following tables to be identified. The tables specify the neural network 
classification given to the defects and features, and feature attributes which need to be 
determined by the image analysis stq) 250 in order for the inference engine step 254 to 
complete identification of the defects and features. 

30 

The tables document the attributes used by the rule base to classify regions. A 
tick indicates that the region should strongly exhibit this attribute whilst a cross indicates 
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that the region should not exhibit this attribute. A dash indicates a dont care situation. 
The tables do not indicate whether the attributes are used in the conjunctive or diqunctive 
manner. 
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The pipe position in rings, clock reference, and the pixels of the regions of interest 
conesponding to each defect and feature identify the precise location of a defect or 
feature. The rules 256 can also be used to resolve location conflicts whidi may occur 
during segmentation and classification when different defects overlap. At least three 
5 different types of conflicts can be resolved, conflicts among superimposed defects^ 
conflicts aniong adjacent defects, and conflicts arising due to classification ambiguities 
between different parts of defects* 

Hie use of the knowledge based interpretation procedure 208 after the 
10 segmentation and classification procedures 202 and 204 oohances the identificaticm and 
detection of surface defects. Furthermore, the database 210 enables the severity of the 
defects to be evaluated and rated, from which a comprehensive report can be generated 
using the report generation procedure 214. 



15 The report is outputted in the following form: 





EHstance 
Rings 


Condition 
Code 


Dia/Dim Oodc 
at to 


% 


Remarks 
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0103 




Surface Erosion Slight 


20 
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35 
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In order to allow further evaluation of defect severity^ and to provide information 
about changes in pipe condition, a Management Information System (MIS) has been 

30 developed. It uses the work station 32 to provide a graphic user inter&ce (GUI) which 
allow the asset manager or engineer to call up selected previously processed data sets, 
and to interactively di^lay the defect regions, or to generate new reports using a 
modified ralebase. The MIS has been written to run in a main window of the display 
211. The main window will list the assessment for eadi of the defects, and allows 

35 display of multiple detailed views of the data related to the defect. These alternate views 
can comprise: one showing the current ring slice of the pipe data, one showmg the 
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cuirent range or unwrapped section of the pipe data, and the other showing a three 
dimensional (3D) display of the pipe data. The MIS can also provide a graph showmg 
variation of rating over time, based on previous pipe inspections. 

5 The MIS has been designed and implemented in a modular fashion* and Figure 

4 shows the main MIS software components. 

Through the NQS, the user (imch as an asset managCT ma^ 
can control access to the data base usirig: the GUL Tbe GUI sub-system allows the user 

10 to specify the operation (either data interpretation, visualisatioiD or comparison) and the 
data to operate on (either the entire list of regions of interest, or a subset of it). Hie GUI 
sub-system invokes the sub-system wfaidi performs tiie particular operation on the data 
requested by tiie user. Hie called sub-system loads the ^eci&ed data from data base 
usmg the fadlities provided by the interfacmg sub-system, if it has not been previously 

15 loaded. When the analysis sub-system is called, it in turn calls components from the 
knowledge base sub-system, to apply the knowledge base(s) to the data. A default 
knowledge base(s) is used except where the user explicitly overrides this default through 
the user interface. 

20 The graphical user interface (GUI) processes interactive user requests that are 

activated using the keyboard and mouse. The GUI provides menus and windows to 
enable easy interaction with the system. It contaii^ the control logic to sequence and 
control the interaction with, and of, the sub-systera& 

25 The GUI provides access to, or invokes fadlities for 

Data load 
Data save 

Knowledge base maintenance 
30 Pipe analysis 

Comparison over time 
Compare two analyses 
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^ Visualise an analysis 

The software uses a computer graphira display to provide visualisation of analysed 
lists of regions of intnest. Various views can be generated depending on a viewing 
5 position and data supplied by the GUI sub-system* That is, when the viewing parameters 
are changed in the GUI, the views are automatically regenerated to reflect this change. 
This sub-system provides display services to the other sub^systems. 

Hie visualisation sub-system generates a required picture from the supplied data, 
10 scales the picture to the appropriate window size and draws the picture into a graphics 
window* 

The following services are provided by this sub-system: 

15 • Cross section view generates a cross-sectional view of the pipe taken at the 
nominated pipe position* The generated image is scaled appropriately to fill the 
viewing window* 

Unwrapped view generates an unwrapped view of the pipe starting at the 
20 nominated pipe position. 

3D view generates a 3D perspective view of the pipe from the nominated pipe 
position* The orientation of the viewing camera is provided to enable the 
generation of the view from almost any position* The generated image is scaled 
25 appropriately to fiU the viewing window* 

Grapiiing produces a 2D line graph from the two data vector parameters* 

A comparison sub-system relates multiple pipe condition assessment results* A 
30 time-based rating of assessment results can be assembled and displayed as a graph* 

The following is an example of the service provided by this sub-system: 
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Comparison over time examines all analysed lists of regions of interest for a 
given pipe and for each list extract and time stamp the assessment rating. 

An interfacing sub-system provides a level of abstraction between the system and 
5 the underlying opiating system and any external systems that require inter&cing to. This 
subsystem is intended to provide a library of interfacing services (which are 
implCTientation, or organisation* specific). 

The following services are provided by this sub-system: 

Data load reads data from the supporting file system and converts it into a form 
suitable for the internal set of regions stmcture. 

Data save extracts data from tfie mtemal set of regions of interest and converts 
15 it into a fimn suitable for writing to the underlying file system* 

Pipe directory interrogates the file system and returns the set of all pipe 
identifiers. 

20 * Analysis directory interrogates the file system and returns the set of all analysis 
identifiers for a given pipe. 

Analysis export extracts information from the results of the analysis and formats 
the data in a form suitable for import into Water Authority databases. 

25 

Printing displays results on a printer device* 

The data managed by the MIS system is primarily made up of list of regions of 
interest information for a pre-processed pipe image. The information stored in, or 
30 calculated for, each region of interest consists of region attributes which include: region 
location in the pipe; an image of the region, a region type descriptor, a region 
classification, area, perimeter, cross-sectional area loss, geometric descriptors, rating, etc. 
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Hie list of legions of interest encapsulates the information used for condition 
assessment from the mw sensor pipe data. This list of regions of interest is a main data 
component within the system 2 and it is extensively used by both the analysis and 
comparison subsystems via an mterEadng sub-system. 

5 

The pipe image is a form of annotated grid of pixel values representing a pipe 
surface in 3D space. 

The lisi cf regions cf interest contains attribute and sub-image infonnatibn for 
10 es^ segmented region. 

A knowledge base repiesentation is another data structure^ which is an internal 
representation of an ASCII file of structured English-like declarative rules and fimctions. 

15 Bow pipe data from the sensors is supplied to the pre-processing module in 

real-time or as a file. After pre-processing and compression the pipe image data is 
tran^oimed into ^listcf regions of interest and put into the data base. This data base 
can be archived or input directly into MIS to perform pipe analysis. For a given pq)e 
there may be many of regions of interest, each one corresponding to a particular run 

20 of a gtven sensor through the pipe. 

The intarfiadng sub-system provides an abstract conduit between the data used 
by the MIS and die data base stracture within the underiying operating system^ as well 
as external data bases to whidi the user required information about the list of regions of 
25 interest may be sent to» or retrieved from. 

Assessment rules are iapot from the usa into a knowledge base representation 
used by the knowledge base sub-system with a text editor. Tlie knowledge base 
representation can also be compiled directly into the knowledge base sub-system. 

30 

The implementation of the graphical user interface (GUI) assumes the availability 
of a mouse and a colour graphical di^lay. The MIS is designed to be interactive, and 
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a user is required at most stages of MIS processing. However^ most analysis actions of 
the system 2 can be performed if desired, in a batdi mode (Le. without us« 
intervention). 

S The MIS can be operated independent of the data collection device, in a ofBce 

environment using an appropriately configured and £ast Sun Microsyston's Spaic iO 
workstation. Hie recommended initial configuration of the wodtstafion is: 

Smgle or dual CPU SPARC 10 Mbus module 
10 32 MB or more in parity SINBAS 

SCSI-2 controller 

1.0SGB fast internal SCSI-2 hard disk 
19^ colour display capable of 1280x1024 resolution 
bidustry standard keyboard and mouse 
15 IEEE 8023 Ethernet and serial ports 

ISOMB 1/4** Desktop Tape Drive 

pre-mstalled: Solaris 2jc, SPARC Compiler C++» Motif Toolkit 

A simplified interface to gather and pre-process raw sensor data can be run on 
20 a minimally configured Sparc workstation installed in a field enviromnent. The transport 
of data from the field to the office woricstation can be via magnetic tape. The 
recommended initial configuration is: 



Smgle CPU SPARC 2 Sbus module 
25 32 MB or more in parity SIMMS 

SCSI-1 controllw 

424 MB internal SCSI-1 hard disk 

19" colour display capable of 1280x1024 resolution 

Industry standard keyboard and mouse 
30 IEEE 8023 Ediemet and scdal ports 

150MB IM** Desktop Tape Drive 

pre-installed: Solaris 1 jc» XGL Graphics Software 
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Appendix: Vehicle motion correction 



1 Introduction 

Data from both laser and sonar scanners is processed into the form of cylindrical coordinates 
(r, 9, z). This data can be corrected for movement of the vehicle relative to the pipe axis. This 
can improve measurement accuracy as the vehicle may not remain at the center of the pipe and 
oriented parallel with the pipe's longitudinal axis. 

There are two methods to determine Ae required corrections: 

1. measure the motion using sensors, or 

2. use the measured data to estimate the motion of the vehicle* 

A combination of these two. methods is utilised, with sensors being used to measure some of 
the miotions and the measured data being used to obtain the others. 

Figure 18 shows the orientation detector 12 at an arbitrary orientation and position in the 
pipe. The orientation of the vehicle can be described by roll, pitch and yaw angles (0, ^, 
while (x, y, z) coordinates can be used to describe its position. 

2 EUipse fitting method 

The following steps are undertaken to remove the effects of vehicle motion from measurements: 

1. the data is transformed into Cartesian coordinates using: 

Xi = TiCOsOi (1) 

Vi = nsin^t, (2) 

2. an inclusion zone is estimated from the orientation and radius of the previous point; all 
data not in this region is excluded from the estimator so as not to bias the estimates with 
the defects in the pipe, 

3. an ellipse is fitted to the included data using algorithms outlined below, 

4. the data is corrected for rotational misalignment and x- and y-axis translations, 

5. the data is transformed data back into cylindrical coordinates using 

tanOi = ^ / (3) 

Xi Jfi 

The equation of a conic section can be expressed as: 

x^ + wiy^ + W2xy + w^x + w^y + = 0 (5) 
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A general ellipse with center (arc, yc), major and minor axes of a and 6 respectively, rotated 
through 7 radians from the x-axis is shown in Figure 1 9 . 

The equation for the ellipse in the (ar, y) coordinate frame can be determined by suitable 
transformations from the equation of the ellipse in the (x'\ j/") coordinate frame, 

2 / «\ 2 



Using the transformations: 



[x' I _ r COS7 sin7 ] f 1 
y' J ~ t -sin7 COS7 J [ y" J 



iand 



(6) 



[:]=[:-']-[::] 

yields the following equation for the ellipse in the (x, y) coordinate frame: 

(b^ cbs^ 7 + a} sin^ 7) + (5^ sin^ 7 + cos^ 7) ^ 
2 (5^ cos 7 sin 7 — cos 7 sin 7) xy + 
(j-2xc (b^ cos^ 7 + sin^ 7) + 2yc (a^ cos 7 sin 7 - cos 7 sin 7) ) x + 
(ixc (a^ cos 7 sin 7 - fe^ cos 7 sin 7) - 2yc (tl^ sin^ 7 + cos^ 7) ) y + 
(b^ cos^ 7 + sin^ 7) xl + (b^ sin^ 7 + cos^ 7) y^ + 
2 (fi^cos7sin7 - a2cos7sin7) Xc^c + 

Equating the coefficients of Equation 6 to those in Equation 5 results in ttie following equations 
forthetx;«. 

(y^ sin^ 7 + eos^ 7) 

(i^ cos2 7 + sin^ 7) 



= Q 



111! = 



(7) 



W2 



^ 2 (6^cos7sin7 — a^cos7sin7) 



W2 = 



W4 = 



Ws = 



(*2 cos^ 7 + a2 sin^ 7) 
-2 (b^ cos^7 + sin^7) Xc + 2 (fi^ - a^) cos7sin7 ye 

(62cos2 7 + a2sin^7) 
-2 (jfi - a^) cos 7 sin 7X0 - 2 (ft^ sin^ 7 + cos^ 7) yt 

(52 cos^ 7 + a2 sin^ 7) 
(6^ cos^ 7 + sin^ 7) + 2 (6^ - g^) cos 7 sin 7X0 yc + (fr^ sin^ 7 + cos^ 7) y^ - 



(b^ cos^ 7 + g^ sin^ 7) 



The TV observations are set up as follows: 



y? Xl yj 1 

y| X2y2 X2 y2 1 



Vn ^AryAT i// yiv 1 . 









u;2 
















u;5 







(8) 
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The required parameters (7, o, 6, Xc, Pc) can be obtained by solving the set of equations in 
Equation 7. First introduce the substitutions: 



p 




w^ + wl — 2wx + 1 


Qo 




— w\w\ + 4w\Ws 


Qy 




w\ws — w\w\ + 2w\w$ — u?4 + u;5 


Q2 




w^w^iwx — l)sin7 


<?3 




'-4w\w$ + 6i£;i.ti;3 — 16u;iti;s + 6w\ — 41^5 


R 




6^ cos^ 7 + sin^ 7 


S 




6^ sin^ 7 + cos^ 7 


T 




(5^ — a^j cos 7 sin 7 



The required parameters (7, a, 6, Xc, yc) are given by: 

7 = 2tan-'^"'-^ + ^^^^/"'-^-^^j, (9) 

v/(3o - SQi cos6 7 + 8Q2 cos^ 7 + 12Qi cos^ 7 - 8Q2 cos^ 7 + cos^ 7 + 2Q2 cos 7 

a == ^ (10) 

2 {w\ cos^ 7 + cos^ 7 — tui) y cos^ 7 + cos^ 7 — 1 

— 8Q1 cos* 7 + 8Q2 cos^ 7 + 12Q 1 cGs^ 7 — 8(52 cos^ 7 + cos^ 7 + IQ2 cos 7 

2 {w\ cos^ 7 + cos^ 7 — 1) yj'^i cos^ 7 + cos^ 7 — 

2V i25-r2 ;» ^^^^ 

(14) 

3 Transforming elliptical data 

Using the estimated ellipse parameters the data can be transformed into a circle by a single 
rotation (a) about a vector (k) from the center of the ellipse along its minor axis (6) which also 
forms the radius of the circle. From the ellipse fitting procedure we know the angle 7 that the 
vector k makes with the y-axis, see Figure 2 0 

k = — sin75c + cos7^ 

The desired angle a is given by: 

a = cos-»(^) (15) 

Using the general result from '^Robot Manipulators: Mathematics, Progranuning, and Gontrol'* 
by R. P. Paul, MTT Press, 1981 we have that the transformation matrix associated with this 
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rotation is givoi by: 

1 — cos^7 + cosacos^7 sin 7 cos 7 cos a — sin 7 cos 7 cos7sina 0' 
_ sin 7 cos 7 cos a — sin 7 cos 7 cos^7 — cosacos^7 + cosa sin7sina 0 
— cos7sina — sin7sina cosa 0 

0 0 0 1 

(16) 

4 Determining yaw and pitch angles 

The yaw (V*) and pitch (^) angles of the vehicle can be detennined frona the fitted ellipse. 
The transformation of the measured data point (a;J,y?,ar,0 to the point on the circle ixuyuzd can 
either be performed by: 

1. rotation of a about vector k, as above, or 

2: rotation of 0 about the x-axis and then ^ about the y-axis. 



where as previously 


-1 <* 

a = cos ' -r 










For a rotation of ^ about the x-axis we have: 










Pitch = 


"10 0 

0 cos ^ — sin ^ 
0 sin <f> cos (f> 
.00 0 


0 ^ 

0 

0 

1 . 






(17) 


For a rotation of ^ about the new y-axis 










Yaw = 


cos^ 0 sinV* 
0 1 0 

— sin ^ 0 cos ^ 
0 0 0 


0 ■ 

0 
0 

1 . 






(18) 


Therefore the combined transformation matrix is: 












cos^ sin^sin^ 
0, cos(A 


i sin^cos^ 

— sin 1^ ., 


0 ■ 
0 




VP = [VawJlPitchJ = 


— sin^ cos0sin^ 
0 0 


f> cos ^ cos ^ 
0 


0 

1 . 


CT9r 



Thus the required angles can be obtained from equating the matrices in 16 and 19. Using the 
trace of both matrices gives one equation as follows: 

cos0 + cos^ + cos^cos^+ 1 = 2 + 2cosa (20) 

and equating the differences between the elements on the respective off'-diagonals of the two 
matrices (yP[3, 1] ^ YP[l,3] = K[3, 1] - K[U3]) and iYP[3,2] - yPl2,3] = K[3,2] - 
^(3.3])g}yeiffbefql|pw|ngl 

-sln^^-alnV»oo8<i ^ -2filn78inf* (21) 
sin^ + cosV^sln^ = -2 sin 7 sin a (22) 
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Solving for ^ and ^ using Equations 20 and 21 yields: 

/ -I /'cos7sina\ 

rl) = 2tan I — — i ) (23) 

\l+cosa/ ^ 

, _i /l — cos^ + 2coso\ 

* = i — TTZ^ — j . (24) 

while using Equations 20 and 22 yields: 

, /2sin7sina — cos0\ 

= I (^) 

\l+cosa/ 

5 Applying center correction to data in cylindrical coordinates 

Figure 21 shows the geometry of the correction required to be applied to a measurement (ar,-, 
Vi) taken from a position not in the center of the pipe. 

The center of the pipe is given by the coordinates (xc, Ve) from the current position. The 
known parameters are the angle 0i and the measured radius (r,). It is desired to convert these 
parameters into those at the center of the pipe (f Si). The corrections required are: 

f'i = y/rf + r^ + Ir^ri cos(A - $i) (27) 

= -'(^^) 

S ._, /"re sin(A — 

= sin • \^ ^- llj - 0, (29) 

(30) 

where A is the angle between the nominal horizontal given by A = tan"' (2^), and re is the 
distance from the current position (arc, yc) to the center of the pipe given by Tc = y/xf+y^. 
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CLAIMS: 



1. An inspecticm s}rstem for a conduit compiising measuiement means for traveiling 
in said conduit and obtaining data on said coi^uit, and processing means for processing 

5 said data to identify regions of said conduit conesponding to defects in said conduit* 

2. An inspection system as daimed in claim 1, whoein said processing means 
indudes means for extracting dimCTsion data on said ocmduit from said data obtained bjr 
said measurement means. 

10 

3- An inspection system as claimed in claim 2, wlierein said dimension data 
comprises a plurality of circumferential data of the inner surface of said conduit^ sdd 
circumferential data each conresponding to points along the path of travel of said 
measurement means. 

15 

4. An inspection system as claimed in claim 3, wherein said processing means 
includes movement correction means for adjusting said circumferential data to account 
for movement of said measurement means within said conduit.. 

20 5. An in^>ection system as claimed in clmm 2, wherein said processing rueans 
indudes segmentation means for processing said dimension data into segments which 
represmt regions whidi could correspond to defects in said conduit 

6* ' An inq>ection system as daimed in daim 5, wherein said processing means 
25 indudes image preprocessing means for generating a grid map of depth values 
coire^nding to the inner surface of said conduit from said dimension data, said grid 
map providing an image of said surface with pixels of said imag^ having a corresponding 
depth value. 

30 7. An inspection system as claimed in daim 6, wherein said segmentation meai^ 
indudes feature extraction means for generating feature data and forming a feature vector 
with the feature data for each pixel. 
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An inspection system as claimed in claim 7, wherein said segmentation means 
includes means for determining pixels of interest from the feature vectors and assigning 
respective labels to predetermined types of said pixels of interest. 

9. An inq>ection system as daimed in claim 8, wherein said segmentation means 
indudes meam for forming said segments by grouping said pixels of interest having said 
labels which are similar into said regicms. 

10. An inspec^on system as claimed in daim 5, wherein said processing means 
indudes dassification means for processing said segments so as to classify said segments 
as ccmesponding to predetermined features of said conduit. 

11. An inspection system as claimed in daim 10, wherein said classification means 
includes a neural network classifier for dassifying said segments. 

15 

12. An inspection system as daimed in claim 11, wherein said dassification means 
includes means for filtering said segments^ means for rescaling the filtered segments, 
means for transforming the rescaled segments from a i^atial domain to a power domain, 
and means for wedge-ring sampling the transformed segments for application t the 

20 neural network classifier. 

13. An inspection system as daimed in daim 11, wherein said neural network 
classified' indudes a plurality of neural networks for determining whether said segmente 
cone^pcmd to one of a plurality of predetermined features, respectively. 

25 

14. An inspection qrstem as daimed in daim 10, wherein said processing means 
indudes interpretation means for processing a dassified segment to obtain attributes of 
tile corresponding feature for identifying said feature on the basis of said attributes and 
feature data. 

30 

15* An inspection system as claimed in claim 1, wherein said measurement means 
indudes laser scanning means. 
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16. . An inspection system as daimed in claim 1 or IS, wherein said measurement 
means includes sonar scanning means. 

17. An inspection system as claimed in claim 1 or 4, wherein said measurement 
5 means includes means for detecting the position and orientation of said measurement 

means in said conduit 

18. An inspecHnti system as clflimed in diaiin 1.^^ wherein gairl lacftf gf'^ftping mennff 

includes a laser, means for circulating a beam gracrated by tiie laser against the surface 
to of said obndui^ and camora means for producix^ image data lepresmtative of aicas 
illuminated by said beam. 

19. An inqpecdon system as claimed in daim 17, wherein said processing means 
includes meai^ for extracting, from said image data, position data for pixels of a lasn 

15 trace produced by said beam. 

20. An inspection system as claimed in daim 16, wherein said scmar scanning means 
indudes a rotating sonar transducer for emitting sonar signals to and receiving sonar 
echoes from the innw surface of said conduit 

20 

21. An inspection system as daimed in daim 20, wherein said processing means 
includes meaius for obtaining r,0 dimension data on said inner surface from said sonar 
echoes by performing curve analysis on said sonar echoes and monitoring the angular 
position of said rotating sonar transducer. 

25 
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FIGURE 2 
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